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Abstract—INTRODUCTION: A full-scale 
simulation exercise is a comprehensive drill 
designed to replicate a real-world emergency 
scenario, thereby identifying the strengths and 
weaknesses in current practices. The overarching 
goal is to enhance healthcare system resilience 
through improved protocols, as highlighted in 
this systematic review tailored for researchers. 
The study aims specifically to assess the impact of 
full-scale simulations on enhancing hospital 
disaster plans. 


METHODS: Following PRISMA guidelines, this 
systematic review investigates the impact of full- 
scale simulation exercises on hospital disaster 
preparedness. The focus was on hospital staff 
involved in disaster and emergency preparedness 
training. The primary intervention was the 
execution of full-scale simulation exercises, and 
our research included various study designs, 
including randomised controlled trials and 
observational study designs. A comprehensive 
electronic database search was conducted, 
spanning PubMed, Scopus, Web of Science, and 
the Cochrane Central Register of Controlled 
Trials, from inception until October 9, 2023. The 
risk of bias was assessed using NIH tools. 


RESULTS: The literature search yielded 2,398 
results, with 28 publications finally included in 
the systematic review. Summarising a broad 
range of disaster preparedness simulation 
exercises with a specific focus on full-scale 
simulation (FSS), the studies consistently 
demonstrated a positive impact on participants' 
skills, as well as identifying safety issues in 
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hospital settings. Moreover, they revealed that 
simulations effectively addressed crucial areas for 
improvement in disaster response, including 
communication breakdowns, equipment 
deficiencies, and flaws in emergency plans. The 
studies utilised a multidimensional approach to 
evaluation metrics, encompassing non-technical 
skills, communication, teamwork, decision- 
making, and operational readiness. The exercises 
varied in duration from 30 minutes to multi-day 
simulations, covering a diverse range of disaster 
scenarios, such as mass casualties, viral 
epidemics, large aviation accidents, and terrorist 
attacks. 


CONCLUSION: Full-scale simulation exercises 
are a preparatory learning tool to test facility and 
staff readiness for complex emergencies. This 
systematic review focused on the different 
exercise scenarios used to address critical aspects 
of disaster response, such as communication 
breakdowns, equipment deficiencies, and flaws in 
emergency plans. The scenarios and _ their 
duration were varied, and _ involved a 
multidimensional approach to evaluation. Such 
exercises enhance critical thinking and problem- 
solving skills, increase familiarity with potential 
emergencies, and build confidence in making 
judgments in real-world situations. In our 
opinion, there is a need for further programs that 
align simulation exercises with community 
resources for better preparedness in the face of 
public health disasters. 


Index Terms—Disaster Preparedness; Disaster 
Readiness; Emergency Department; Emergency 
Response; Full-Scale Exercise; Full-Scale 
Regional Exercise; Hospital Emergency; Mass 
Gathering Events. 


I. INTRODUCTION 


A disaster is a natural or man-made occurrence that 
causes significant loss to human life, property, 
economy and environment, and disrupts the 
operation of the affected society or community to the 
point where outside assistance is required to address 


E-mail: jameel.abualenain @ gmail.com 


The Journal of Medicine, Law & Public Health Vol 4, No 3. 2024 


the deteriorating situation (1). In recent years, the 
world has seen an increase in extreme scenarios, 
including both man-made and natural disasters, 
conflicts, and societal upheavals. The Third UN 
World Conference on Disaster Risk Reduction in 
2015 affirmed the widespread impact of such events 
on a global scale, resulting in more than 700,000 
deaths and 1.4 million injuries. Additionally, it was 
projected that these calamities affected more than 1.5 
billion individuals, resulting in economic losses 
surpassing 1.3 trillion US dollars (2,3). It is therefore 
critical to prioritise timely, effective, and long-term 
interventions for vulnerable populations. 
Recognising the importance of the effective 
management of catastrophic events will ensure 
greater emphasis on generating and sharing 
information and training in this field to assure 
preparedness and competence in such crucial 
situations (4,5). 

According to the World Health Organization's 
Hospital and Health Facility Emergency Exercises 
Guidelines, there are five commonly utilised types of 
emergency exercise: orientation, tabletop, drill, 
functional, and full-scale simulation exercises (6). 
Simulation is a representation of real-life events and 
can take many forms, including computer software, 
case studies, written clinical scenarios, simulated 
patients (SPs), role-playing, or replicating reality 
with simple or advanced functionalities (7,8). This 
wide range of modalities allows for diverse and 
thorough simulation of real-world scenarios (7,8). 
Real simulation with actors has been used for almost 
50 years, demonstrating its continued utility and 
efficacy in a variety of sectors (7,8). 

Full-scale exercises are characterised by their 
leadership (typically conducted by controllers) and 
the involvement of participants across all levels of 
personnel (6). These exercises should simulate a 
realistic setting, including the activation of 
emergency operations centres, and their duration can 
range from two hours to more than one day (6). The 
preparation for such exercises is extensive, often 
requiring 1—-1.5 years of development (6). This 
preparation includes significant time, effort, and 
resources, as well as the incorporation of preparatory 
drills, tabletop exercises, and functional exercises 


(6). 
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Full-scale simulation exercises in hospital disaster 
preparedness are immersive, all-encompassing drills 
designed to imitate real-world emergency 
circumstances, and involving the active participation 
of various hospital departments, including healthcare 
professionals, administrative workers, and support 
personnel (8-10). The scenarios are meticulously 
designed to simulate natural disasters, mass 
casualties, or infectious disease epidemics, putting 
the hospital’s reaction and coordination capabilities 
to the test (11). The multidisciplinary approach 
ensures that teams collaborate effectively, and 
scenarios frequently vary to measure adaptation. 
Communication systems are exhaustively tested, and 
the entire exercise is analysed and followed by a 
thorough debriefing (10,11). 

Understanding the influence of full-scale simulations 
on hospital disaster preparedness is critical for a 
number of reasons. For starters, it provides a detailed 
examination of the strengths and shortcomings of 
current practices, allowing hospitals to discover gaps 
and opportunities for development in_ their 
preparedness plans. The findings can be used to 
design more resilient and adaptive protocols to 
handle real-world difficulties, ultimately improving 
the resilience of healthcare systems in the face of 
calamities. This systematic review aimed to illustrate 


these points, and to provide further 
recommendations for future researchers. 
Il. METHODS 


The findings of this study were reported in 
accordance with the PRISMA - statement 
requirements (12), and all procedures were carried 
out in exact conformity with the Cochrane Handbook 
of Systematic Reviews and Meta-Analysis of 
Interventions (version 5.1.0) (13). Due to the 
heterogeneity of the studies, the narrative synthesis 
approach was used to report the findings. 


Eligibility criteria 
Studies were included in our review if they satisfied 
the criteria described in Table 1. We have excluded 


animal and in-vitro studies, studies with no full text 
available, studies presented solely as abstracts or 


Table 1. Description of inclusion criteria 


Arms Description 


Population 


preparedness training. 


Hospitals and their staff who have participated in disaster and emergency 
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Intervention | Full-scale simulation exercises are the intervention of major interest. 

Outcome Recognising the challenges associated with noncompliance, evaluating the time 
required to assemble a crisis management team, and investigating the effect of full- 
scale simulations on the quality of the disaster plan. 

Study Included in the study are randomised controlled trials, quasi-experimental trials, 

Design pilot studies, cluster trials, and other observational study designs. Cross-sectional, 
retrospective, and prospective cohort studies are examples. 


posters, studies from overlapped databases, and electronic databases (PubMed, Scopus, Web of 
various non-primary research sources such as Science, and Cochrane Central Register of 
reviews, book chapters, theses, comments, letters, Controlled Trials), from inception until October 9, 


and editorials. 


Information sources and search strategy 


2023, using the queries described in Table 2. 
Additionally, the references of the included studies 
were manually searched for potentially eligible 


We performed a comprehensive search of four studies. 


Table 2. Description of different database search strategies 


Database 


Results 


Search Strategy 


PubMed 


1,288 


All Fields: ((Full-scale simulations OR Full-scale regional simulations OR Full- 
scale regional simulation OR FSRE OR Simulations scenarios OR Full-scale 
exercise OR FSEs OR Simulations Training OR Simulations system OR 
Simulations OR High-fidelity stimulation OR Online simulations OR Simulating OR 
Simulator OR Simulation modelling OR Simulation modeling) AND (Preparedness 
OR Readiness) AND (Hospital)). 


Scopus 


538 


Article title, Abstract, Keywords: ((“Full-scale simulations OR “Full-scale regional 
simulations“ OR “Full-scale regional simulation“ OR FSRE OR “Simulations 
Scenarios“ OR “Full-scale exercise“ OR FSEs OR “Simulations Training“ OR 
“Simulations system“ OR “Simulations“ OR “High-fidelity simulation“ OR “Online 
simulations“ OR “Simulating“ OR “Simulator“ OR “Simulation modelling OR 
“Simulation modeling“) AND (“Preparedness OR “Readiness“*) AND 
(“Hospital‘)). 


Web of 
Science 


434 


All Fields: ((‘“Full-scale simulations“ OR “Full-scale regional simulations“ OR 
“Full-scale regional simulation“ OR FSRE OR “Simulations Scenarios“ OR “Full- 
scale exercise“ OR FSEs OR “Simulations Training“ OR “Simulations system“ OR 
“Simulations OR “High-fidelity simulation“ OR “Online simulations OR 
“Simulating OR “Simulator OR “Simulation modelling’ OR “Simulation 
modeling“) AND (“Preparedness OR “Readiness“) AND (‘“Hospital“)). 


Cochrane 


138 


Keywords, Title: ((“Full-scale simulations“ OR “Full-scale regional simulations“ 
OR “Full-scale regional simulation“ OR FSRE OR “Simulations Scenarios“ OR 
“Full-scale exercise“ OR FSEs OR “Simulations Training“ OR “Simulations 
system“ OR “Simulations“ OR “High-fidelity simulation“ OR “Online simulations“ 
OR “Simulating“ OR “Simulator OR “Simulation modelling OR “Simulation 
modeling“) AND (“Preparedness OR “Readiness“*) AND (“Hospital*‘)). 


Selection process 


The retrieved references were screened in two steps: 
first, the titles/abstracts of all identified articles were 
screened independently by all the authors to 
determine their relevance to this review, and second, 


the full-text articles of the identified abstracts were 
screened for final eligibility. The Rayyan platform 
was used to aid the selection process (14), and 
duplicates were eliminated using Endnote, a tool 
provided by Clarivate Analytics (Pennsylvania, 
USA). 
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Data collection process and data items 


Data were extracted from a uniform data extraction 
sheet, and included: (1) Characteristics of the 
included studies, (2) Characteristics of the 
populations of the included studies, and (3) Outcome 
measures. 


Risk of bias assessment 


According to the Cochrane Handbook of Systematic 
Reviews of Interventions 5.1.0 (updated March 
2011), we used the National Institutes of Health 
(NIH) quality evaluation tools for cross-sectional, 
cohort, case-control, and intervention studies to 
assess the quality of quantitative studies (15). We 
used Noyes et al.'s recommendations for qualitative 
investigations, and the Mixed Methods Appraisal 
Tool (MMAT) for mixed-method studies (16). Two 
reviewers worked separately on the evaluation, and 
any inconsistencies were handled through discussion 
with a senior reviewer (17). Each tool had its own set 
of criteria, on the basis of which the studies were 
graded as good, fair, or poor. 


Data synthesis 


Due to the great variation in the objectives, design 
and settings of the studies, we used a narrative 
synthesis method to describe the key characteristics 
and findings in tables. We did not plan to conduct 
meta-analysis or measure confidence in cumulative 
evidence, due to the substantial heterogeneity of the 
included studies (cross-sectional, cohort, mixed 
techniques, and qualitative research). 


III. RESULTS 
Literature search results 


The literature search produced 2,398 results, 605 of 
which were duplicates. Following title and abstract 
screening, 59 papers were subjected to full-text 
screening, with 28 publications finally included in the 
systematic review. A further search within the 
references of the included studies yielded no other 
eligible papers. Figure 1 of the PRISMA flow 
diagram depicts the study selection process. 


Characteristics of included studies 


The varied range of studies included in this review 
provided useful insights into the successes and 
limitations associated with different techniques. The 
overarching observation across all of the studies was 
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the positive influence of simulations on participant 
education and_ readiness. Notably, full-scale 
simulation (FSS) emerged as a_ consistently 
successful approach to improve participants’ skills 
and uncover potential safety issues in hospital 
settings. The details of the 28 studies included in this 
review are summarised in Table 3. 

Details of the parameters of the included studies are 
laid out in Table 4. This includes each study's country 
of origin, design, setting, recruitment methods, 
participant count, and evaluation measures. The 
geographical diversity of the studies, from battle 
zones in Afghanistan to trauma clinics in the United 
States, reveals a truly global perspective on 
catastrophe preparedness. Such variety improves the 
dataset by documenting the various techniques 
required in diverse sociopolitical and healthcare 
environments. Prospective cross-sectional studies, 
pre-post intervention surveys, qualitative inquiries, 
mixed-method designs, and observational studies are 
among the study types available. The settings range 
from simulated hospital settings to real-world trauma 
centres, each offering a unique viewpoint on crisis 
management. 


Evaluation metrics 


The studies employ a broad spectrum of evaluation 
metrics, including non-technical skills, 
communication, teamwork, decision-making, and 
operational readiness. This multidimensional 
approach ensures a thorough evaluation of the skills 
and competencies required for effective disaster 
response. Regarding the evaluation method, most 
studies employed a combination of quantitative and 
qualitative assessments, such as __ surveys, 
standardised tools, and checklists, as described in 
Table 5. This all-encompassing strategy guarantees 
that participants' preparedness, teamwork, and crisis 
management abilities are well understood. 

The duration of the exercises varies greatly, ranging 
from 30 minutes to a multi-day simulation. Such 
variation allows for flexibility based on the individual 
objectives of each exercise. 

The studied simulations also span a wide range of 
disaster scenarios, including mass casualties, viral 
epidemics, large aviation accidents, and terrorist 
strikes, as illustrated in Table 5. This breadth 
guarantees a thorough approach to _ disaster 
preparedness, covering a number of potential 
obstacles that healthcare personnel may encounter. 
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Study ID 


Arora 2014 
(18) 


Bartley 
2006 (19) 


Burke 2014 
(20) 


Table 3. Summary of studies included in the present systematic review and meta-analysis 


Title 


Towards the Next Frontier 
for Simulation-Based 
Training Full-Hospital 
Simulation Across the 
Entire Patient Pathway 


What a Disaster?! 
Assessing Utility of 
Simulated Disaster 
Exercise and Educational 
Process for Improving 
Hospital Preparedness 


Using Mixed Methods to 
Assess Pediatric Disaster 
Preparedness in the 
Hospital Setting 


Aim 


Evaluate efficacy of 


full hospital 
simulation 


Assess impact of 
audiovisual 
presentation and 
simulation for 
hospital disaster 
planning 


Assess disaster 
response with a 
paediatric focus 


Results 


Outstanding skill evaluation 


reliability: considerable 
improvements in decision- 
making, trauma care, and 
situational awareness 
successfully transferred to 
civilian practice. 


Significant knowledge 
improvement but sub- 
optimal preparedness 
perceptions. Calls for 
increased efforts in hospital 
disaster preparedness. 


Disaster exercise enhanced 
paediatric response 
readiness. Identified areas 
for improvement included 
communication, equipment, 
physician involvement, 
safety, security, staff roles, 
and triage exercises. 


Limitations 


Self-report data 
limitations, 
military setting 


Selection bias, 
small participant 
numbers 


Potential selection 
bias, voluntary 
response bias, 
reliance on self- 
reported feedback 
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Conclusion 


HOSPEX enhances 
skills with minimal 
waste of resources. 


Disaster exercise 
benefits individuals, 
prompts plan review, 
and suggests ongoing, 
cost-effective 
strategies including 
educational tools, 
mandatory hospital- 
wide involvement, and 
hiring a full-time 
Emergency 
Management Officer. 


Focus on 
communication, 
responsibilities, safety, 
triage, and equipment 
enhances 
preparedness. 
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Carmichael 
2021 (21) 


Campanale 
2022 (22) 


Clara 2021 
(23) 


Cristal 2019 
(24) 


Integration of In Situ 
Simulation into an 
Emergency Department 


Assess ISS impact on 


Code Orange Exercise ina mass-casualty 


Tertiary Care Trauma 
Referral 
Center 


Hospital preparedness for 
mass gathering events and 
mass casualty incidents in 
Matera, Italy, European 
Capital of Culture 2019. 


Testing early warning and 
response systems through 
a full-scale exercise in 
Vietnam 


Integrating Simulation- 
Based Exercises into 
Public Health Emergency 
Management Curricula 


response 


Enhance hospital 
preparedness for 
MCIs 


Test early warning 
systems for COVID- 
19 pandemic in 
Vietnam using FSE 


Evaluate simulation 
in public health 
emergency 
management using 


ISS improved participant 
education and revealed latent 
safety hazards through a 
realistic experience. 


Implementation and 
improvement of PEMAF 
plan through the MACSIM- 
PEMAF program, leading to 
potential instructors and 
official delivery to 
authorities. 


Effective MOH surveillance, 
successful triage, and risk 
assessment. Challenges 
noted in infection control 
and documentation. 

Positive feedback, 
experience correlated to 
obtaining internships, 
highlighting the 


Actor-related 
issues, 
pharmacological 
situation not 
completely tested, 
no uniform data 
collection form 


NR 


NR 


NR 


ISS enhances hospital 
response to MCI. 


MGEs offer 
significant visibility 
and profit 
opportunities for the 
host community. 
However, they also 
pose a heightened risk 
of MCI. Thus, it is 
essential for the 
healthcare system to 
prioritise both 
prevention and 
preparedness to 
effectively address 
potential emergencies. 


FSE highlights the 
importance of 
practicing surveillance 
before emergencies. 


Simulation-based 
activities improve 
public health readiness 
and resilience. 
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Djalali 
2014 
(25,26) 


Dube 2020 
(26) 


Facho 2021 
(27) 


Farahi 2021 
(28) 


Does Hospital Disaster 
Preparedness Predict 
Response Performance 
During a Full-scale 
Exercise? A Pilot Study 


COVID-19 pandemic 
preparation: using 
simulation for systems- 
based learning to prepare 
the largest healthcare 
workforce and system in 
Canada 


Small-Scale High-Fidelity 
Simulation for Mass 
Casualty Incident 
Readiness 


A simulation—optimization 
approach for measuring 
emergency department 
resilience in times of crisis 


simulation-based 
exercise 


Investigate the 
relationship between 
disaster preparedness 
and response during 
FSE 


Assess simulation in 
COVID-19 education 
using real person 
exercise 


Assess readiness for 
MCI using high- 
fidelity simulation 


Propose a simulation- 
optimisation 
approach to assess 
ED resilience during 
disasters 


effectiveness of simulation- 
based activities. 


Selected hospital 
demonstrated 59% 
preparedness and 70% 
response performance. 
Successful application of 
Simple Triage and Rapid 
Transport (START). 


COVID-19 response team 
conducted impactful 
simulations, addressing 2500 
system issues. Tremendous 
impact on learners in urban 
and rural settings. 


Enhanced confidence and 
realistic experience in high- 
fidelity MCI simulation. 
Positive perceptions guided 
hospital plans; scores 
averaged 5 for educational 
value, 4.8 for realism, and 
4.8 for effectiveness. 
Simulation-optimisation 
evaluated healthcare 
responsiveness, providing 
insights into system 
behaviour in crisis settings. 


Limited by single- 
hospital sample 


Limited to single 
institute, 
generalisation 
concerns 


NR 


NR 
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FSE shows the 
viability of using 
standardised tools to 
assess preparedness 
and reaction. 


FSE is critical for 
COVID-19 readiness; 
emphasises the 
importance of quick, 
in-person simulation 
for effective 
healthcare planning. 


Simulation 
successfully increases 
participants’ 
confidence regarding 
MCI. 


Simulation- 
optimisation enhances 
healthcare resilience. 
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Foo 2021 
(29) 


Gillett 2008 
(30) 


Gryth 2010 
(31) 


Haverkort 
2017 (32) 


A 36-Hour Unplugged 
Full-Scale Exercise: 
Closing the Gaps in 
Interagency Collaboration 
between the Disaster 
Medical Assistance Team 
and Urban Search and 
Rescue Team in Disaster 
Preparedness in Taiwan 


Simulation in a Disaster 
Drill: Comparison of 
High-Fidelity Simulators 
Versus Trained Actors 


Evaluation of Medical 
Command and Control 
Using Performance 
Indicators in a Full-Scale, 
Major Aircraft Accident 
Exercise 


Developing the Fourth 
Evaluation Dimension: A 
Protocol for Evaluation of 
Video from the Patient’s 


Evaluate 
preparedness and 
performance of 
DMATs in a 
simulated crisis 
scenario 


Compare 
effectiveness of 
simulated versus 


actual actor-patients 


in MCI drills 


Assess medical 


command and control 


in major aircraft 


accident using FSE at 


local and strategic 
levels 


Test feasibility of 
incorporating 


patient's perspective 


into traditional 
evaluations of 


Disaster scenario involving 
medical rescue teams 
showed effective command, 
control, and communication, 
and highlighted instances of 
noncompliance in health 
examinations. 


High-fidelity simulators and 
live actors produced 
equivalent results in mass 
casualty drills, emphasising 
the effectiveness of both. 


Performance indicators 
assessed medical command 
and control. Management 
and staff skills scored 15 and 
17 at the strategic level, and 
17 and 21 at the hospital 
level, respectively, revealing 
feasibility for future 
evaluations and real 
incidents. 

Equipping mock patients 
with point-of-view cameras 
in trauma drills enhanced 
communication training and 
identified areas for 


Lack of 
comprehensive 
analysis, potential 
subjectivity 


Non-validated 
survey, Likert 
scale issues, lack 
of inter-rater 
reliability testing, 
non-identical 
paired cases, risk 
of learning bias 


Potential 
differences in 
exercise vs. real 
incidents, lack of 
absolute 
distinction 
between scores 


Preliminary 
nature of study, 
images used by 
multiple 
observers 
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DMATSs were 
successful but 
communication and 
evaluation skills need 
improvement. 


Simulators are as 
effective as live actors 
in MCI drills. 


Performance 
indicators are effective 
for evaluation of 
command and control 
in FSE. 


Point-of-view camera 
enhances trauma drill 
evaluation. Protocols 
should be optimised 
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Juelsgaard 
2022 (33) 


Kohlhoff 
2012 (34) 


Kaplan 
2012 (35) 


Klima 2012 
(36) 


Perspective During Major 


Incident Exercises 


Healthcare professionals’ 
experience of using in situ 


simulation training in 
preparation for the 


COVID-19 pandemic: a 


qualitative focus group 
study from a Danish 
hospital 


Evaluation of Hospital 
Mass Screening and 


Infection Control Practices 
in a Pandemic Influenza 


Full-Scale Exercise 


Use of an Emergency 
Preparedness Disaster 
Simulation with 


Undergraduate Nursing 


Students 


Full-scale regional 
exercises: Closing the 
gaps in disaster 
preparedness 


hospital using 
simulated training 


Investigate impact of 
ISS on COVID-19 
preparedness 


Evaluate mass 
screening protocol, 
isolation, and triage 
in influenza FSE 


Evaluate impact of 
EPDS on nursing 
students 


Assess FSRE in mass 
casualty disaster 
preparedness 


improvement. The approach 
improved non-medical 
aspects and identified areas 
for training and process 
enhancement. 


Positive outcomes from 
simulations for healthcare 
professionals, emphasising 
improved teamwork and 
skills in PPE use. 


Simulated pandemic mass 
screening protocol showed 
correct influenza status 
determination in 74% of 
cases, and effectiveness in 


addressing infection control. 


EPDS received positive 
evaluations from 95% of 
students, indicating 
increased knowledge, 
confidence, and 
preparedness for disaster 
situations. The hybrid 
approach proved cost- 
effective and time efficient. 
Assessment of 16 hospitals 
showed widespread non- 
compliance, with 
communication problems 


Focus on specific 
hospital, potential 
response bias 


NR 


NR 


Lack of training 
with technologies, 
communication 
issues 
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for effective utilisation 
of such footage. 


ISS is valuable for 
pandemic preparation, 
at both organisational 
and individual levels. 


Mass screening and 
other infection control 
measures proved 
feasible and resulted in 
measurable outcomes 
during FSE. 


EPDS enhances 
disaster preparedness, 
skills, and confidence, 
providing a cost- 
effective educational 
experience. 


FSE is crucial for MCI 
readiness, as a 
communication gap 
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McElroy 
2019 (37) 


Obaid 2017 
(38) 


Radestad 
2012 (39) 


Radestad 
2023 (40) 


Operation continued care: 
A large mass-casualty, 
full-scale exercise as a test 
of regional preparedness 


Utilization of Functional 
Exercises to Build 
Regional Emergency 
Preparedness among Rural 
Health Organizations in 
the US 


Combining performance 
and outcome indicators 
can be used in a 
standardized way: a pilot 
study of two 
multidisciplinary, full- 
scale major aircraft 
exercises 


Use of simulation models 
when developing and 
testing hospital evacuation 
plans: a tool for improving 
emergency preparedness 


Assess coordination 
in mass-casualty FXS 


Design and 
implement disaster 
exercises in rural 
areas to test efficacy 


Demonstrate 
feasibility of 
evaluating 
multidisciplinary, 
full-scale disaster 
exercises using 
combined indicators 


Evaluate hospital 
evacuation 
preparedness for MCI 
using simulation real- 
time exercise 


(94%) and staffing issues 
(63%) being common. 


Triage analysis revealed 
strengths but highlighted 
communication failures and 
areas for improvement in 
data entry and resource 
requests. 


Functional exercises 
evaluated command staff, 
fostering regional 
collaboration. Revealed 
barriers to unified command 
and documentation issues. 


Improved performance 
indicators, including 
preventable deaths and 
complications, were 
observed. Additionally, there 
were an adequate number of 
ambulances and injured 
victims considered. 

Tabletop exercises improved 
evacuation plans and critical 
operations. In two exercises, 
71.2% and 52.9% of patients 
were evacuated within 7 and 
4 hours. Positive feedback 
on survey results and a 
desire for more exercises. 


NR 


Limited resources 


Competency 
variations, need 
for real incident 
validation 


Limited 
generalisability 
due to varied 
exercises; low 
response rates; 
exercise did not 
include treatment 
during transport 
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remains in tabletop 
exercises. 


FXS aids 
preparedness, 
highlights 
communication and 
coordination flaws. 


Functional exercises 
vital for testing 
decision-making and 
response, offering 
insights beyond 
tabletop or short, full- 
scale exercises. 


Standardised 
evaluation using 
combined indicators 
allows for meaningful 
comparisons between 
exercises. 


Simulation exercises 
help planners create 
more efficient 
evacuation plans, 
protocols, and 
procedures for MCI. 
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Shrestha 
2022 (10) 


Schumacher 
2022 (41) 


Shah 2013 


(42) 


Full-scale simulation 
exercise—A preparedness 
for trauma mass casualty 
incident: Nepal 


Full-scale simulations to 
improve disaster 
preparedness in hospital 
pharmacies 


Waterworks, a Full-Scale 
Chemical Exposure 
Exercise: Interrogating 
Pediatric Critical Care 
Surge Capacity in an 
Inner-City Tertiary Care 
Medical Center 


Evaluate hospital 
incident command, 
triage, and patient 
transfer in FSS for 
MCI 


Evaluate impact of 
FSS on pharmacy 
emergency readiness 


Assess PICU surge 
plan in chemical 
exposure exercise 


Simulation exercise revealed 
gaps in knowledge and 
skills, indicating room for 
improvement in incident 
command, [mean score of 
161 out of 220 (73.2%)], 
triage, and patient transferal. 
Simulation exercises 
improved task completion. 
Four hospital pharmacies 
initially completed 69%+46% 
of assigned tasks, increasing 
to 84%+7% in the second 
round. Average quality of 
actions improved from 3.0/5 
to 3.6/5, and crisis team 
assembly time reduced from 
23 to 5 minutes with 
challenges in communication 
and crisis management. 


Effective patient care 
transitions in chlorine 
overexposure simulation. 
Identified shortcomings in 
ED care. 


or upon arrival at 
facility 


Single site, 
observational 
design 


Small number of 
participating 
pharmacies, 
subjective 
assessments 


Lack of post- 
instruction 
testing, potential 
ED overstaffing 
bias 
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Simulation identifies 
gaps and highlights 
areas for 
improvement. 


FSS significantly 
improves readiness 
and staff knowledge. 


PICU surge plan 
effective, but ED areas 
need attention. 
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Randomized controlled 
trial of high-fidelity 
Wallace __ patient simulators 


Compare High-fidelity stimulator 
resuscitation times in patients posed challenges in 
pandemic influenza real-time disaster response 


Small sample 


size, lack of real Potential challenges 


using simulators for 


2010 (4 mpar r g seu ee ued se tien : ae 
NCS 2 ae ed sc eeesanee high-fidelity training, with significantly Dae real-time training. 
patients in a pandemic : : comparison 
: : : simulation longer procedures. 
influenza drill scenario 
Noted strengths and ; ; 
: : Conducting an active 
Lessons Learned from an weaknesses, including a lack ee : 
; : : . Artificial nature shooter exercise 
Active Shooter Full-Scale Assess hospital of experience in mass : : : 
Wexler : : ; : of drills, potential provided valuable 
Functional Exercise In a response to active- casualty triage and ied 
2017 (44) : aE staff response insights for 
Newly Constructed shooter scenario communication breakdowns. _,. : : . 
_ . discrepancies improvement without 
Emergency Department Identified educational : , , 
me impacting patient care. 
opportunities. 


ISS: Institutional Simulation Scenario, HOSPEX: Hospital Exercise, PEMAF: Emergency Plan for Massive Influx of Injured, MCI: Mass 
Casualty Incident(s), EPDS: Emergency Preparedness Disaster Simulation, FSE: Full-Scale Exercise, FSRE: Full-Scale Regional Exercise, ED: 
Emergency Department, DMAT: Disaster Medical Assistance Team, FSS: Full-Scale Simulation, PICU: Paediatric Intensive Care Unit, MGE: 
Mass Gathering Event, MACSIM®: Mass Casualty Simulation Tool 


Table 4. Parameters of included studies 


Number of NinCROE 
Study ID Country Design Setting Recruitment mock ae Evaluation metrics 
nee participants 
Nontechnical skills, 
communication, 
a Pee 288 participants teamwork, decision 
Pospective, cross- : : (surgeons, making, situational 
; : Hospital Simulator : : ; 
Arora 2014 Afghanistan sectional pre/post Pe ae rie NR NR anaesthesiologists, awareness, leadership, 
training study Beet physicians, and operational readiness, 
Ae en nurses) patient care, hospital 
& environment, emergency 
procedures 
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Bartley 


2006 Australia 
United 

Burke 2014 Sees 

Campanale 

022 Italy 

Carmichael 

2021 Canada 


Pre/post 


intervention survey 


Qualitative study 


Mixed method 
design of quality 
improvement and 


pre/post educational 


intervention design 


Qualitative study 


Geelong Hospital, 2004 


Victoria October MS 
Three Los Angeles 

(California USA) 2011 May NR 
hospitals 

Madonna delle 


Grazie Hospital eu10 ae 


Adult care trauma 
centre in Ottawa, NR 
Ontario, Canada 


20 patients 


50 members of 
medical, nursing, 
and administrative 
staff 


20 volunteers 


193 participants 
including 
physicians, nurses, 
managers, and 
support staff 


NR 
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Factual knowledge, self- 
assessment, 
improvement of 
personal preparedness 
post-intervention 
Communication, 
equipment and supplies 
usage, paediatric safety, 
staffing, training, and 
specific stations such as 
Incident Command (IC), 
Triage, and Treatment. 
Knowledge of 
organisational 
modalities, 
understanding of 
operative areas, Hospital 
Command Group, 
information signaling, 
MCI phases, triage, 
action cards, staff 
redistribution, surgical 
triage, ‘damage control’, 
surge capacity factors, 
MCI closure 
mechanisms 

Time evaluation, triage 
process, communication, 
formalise centralisation 
of requested resources 
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Clara 2021 


Cristal 2019 


Djalali 
2014 


Dube 2020 


Vietnam 


United 
States 


Italy 


Canada 


Event-based 
surveillance 


Qualitative study 


Pilot study 


Qualitative study 


Quang Ninh 
province 

and Hanoi city, 
with participation 
of public health 
partners at 
community, 
district, provincial, 
regional and 
national levels 


Colorado School 
of Public Health 
Hospitals 


A hospital in the 
Piedmont region 
of Italy 


Healthcare system 
in the province of 
Alberta, Canada. 


2018 August 


2016 


2013 May 


2020 


One case 


NR 


General 
hospital, 
approx. 
300 beds 


NR 


NR 


NR 


NR 


NR 
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Detection, reporting, 
triage, verification, risk 
assessment 


Participants' perceptions 
of the curriculum, its 
applicability to their 
future careers, and the 
overall learning 
experience 
Organisation, 
operational and 
contingency plans, 
critical services, 
resource availability 
Surge planning, 
identification of latent 
safety threats, testing 
and design of COVID- 
19 processes, evaluation 
of medical management 
and infection 
prevention, 
categorisation of 
outcomes based on 
SEIPS 2.0 system, 
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United 


Facho 2021 States 


Farahi 2021 ‘Iran 


Foo 2021 China 
: United 
Gillett 2008 Seiler 


Qualitative study 


Qualitative study 


Observational study 


Prospective cohort 
study 


Kern Medical 
Center 
Emergency 
Medicine 
Department 
Bakersfield, CA 


Adult ED of the 
Persian Gulf 
General Hospital 
in Bushehr, [ran 


Nan Hospital of 
China Medical 
University 


Kings County 
Hospital Center in 
Brooklyn, New 
York, and Tampa 


NR NR 
2021 NR 
2018 

November NR 
December 

2006 and NR 
March 2007 


Three patients in 
round 1; another 
three in round 2 


NR 


30physicians, 65 
nurses, and 74 
logistical personnel 


78 hospital staff 
members 
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iterative development of 
cognitive aids 


Instrumental skills for 
physicians, other tasks 
for nurses and non- 
physicians 


ED scenarios, regular 
operations, crisis 
response, workload 
integration, scenarios 
shaped by historical 
data, patient interarrival 
times adjustment for 
diverse intensity levels 
Technical proficiency of 
Disaster Medical 
Assistance Teams 
(DMATSs), barriers to 
cooperation between 
DMATs and Urban 
Search and Rescue 
(USAR) teams during a 
simulated earthquake 
exercise 

Different scenarios, 
tasks such as triage, 
obtaining vital signs, 
applying oxygen, 
initiating stabilising 
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Gryth 2010 


Haverkort 
2017 


Juelsgaard 
2022 


Kaplan 
2012 


Klima 2012 


Kohlhoff 
2012 


Sweden 


Netherlands 


Denmark 


United 
States 


United 
States 


United 
States 


Qualitative study 


Proof-of-concept 
study 


Qualitative focus 
group study 


Qualitative study 


Qualitative study 


Qualitative focus 
group study 


General Hospital 
in Tampa, Florida 


NR 


Major Incident 
Hospital (MIH) in 
Utrecht, 
Netherlands 


Danish University 
Hospital 


American 
Association of 
Colleges of 
Nursing and 
associated 
Hospitals 


Multi-agency over 
16 areas 


Brooklyn, New 
York hospitals 


2008 
October 


2014 to 2015 


2020 April- 
may 


2008 to 2011 


NR 


NR 


NR 


Two mock 
cases 


NR 


280 
volunteer 
patients 


354 
volunteer 
victims 


NR 


NR 


22 healthcare 
professionals 


90 undergraduate 
nursing students 


NR 


NR 
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interventions, 
completing surveys, 
providing appropriate 
disposition 


NR 


Review of captured 
footage to gain insights 
into patient experience 


ABCDE approach, PPE 
and medical equipment, 
transportation, 
communication, 
decision making in 
critical cases 


Communication, 
supplies usage, 
paediatric safety, triage, 
treatment 


Communication, 
command structure, 
decontamination, 
staffing, patient tracking 
Standardised mass 
screening and infection 
control items with 
coordination, 
communication 
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McElroy United Pee 

2019 Siaies Qualitative study 

cian Se Cltberssesumental 
States design 

oe Sweden Rene 

2012 bisa q e 


evaluation study) 


7 trauma centres, 
30 acute care 
hospitals and free- 
standing 
emergency 
departments, and 
42 emergency 
medical services 
agencies 


Three rural 
Nebraska (USA) 
regions by the 
Center for 
Preparedness 
Education (CPE) 
at the University 
of Nebraska 
Medical Center 
(Omaha, Nebraska 
USA) 


Two 
multidisciplinary 
FSE (major 
aircraft accident) 
in two regions in 
Sweden 


445 
volunteer 
patients 


2017 April 


2010 to 2013, NR 


2008 to 2010 99 victims 


NR 


83 command 
centres, including 
667 participants 


131 and 69 health 
care workers, 
respectively 
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Patients’ entry, triage 
accuracy, 
communication, 
coordination, 
performance, points of 
improvement, resources 
request, patient tracking, 
OHTrac utilisation, 
communication 
assessment 


Command staff, 
identification of areas 
for improvement, 
advancing regional 
collaboration among 
diverse response 
partners and other 
parameters of Homeland 
Security Exercise 
Evaluation Program 


prehospital, regional, 
and hospital command 
and control, as well as 
regional and hospital 
staff procedure skills. 
Key points include 
response time, 
communication 
effectiveness, resource 
allocation, media 
interaction, and staff 


E-mail: jameel.abualenain @ gmail.com 


The Journal of Medicine, Law & Public Health Vol 4, No 3. 2024 


Radestad 
2023 


Schumacher 
2022 


Shah 2013 


Shrestha 
2022 


Sweden 


Switzerland 


Switzerland 


Nepal 


Qualitative study 


Prospective 
multicentre design 


Prospective single- 
centre simulated 
disaster drill 


Observational study 


Two emergency 
hospitals within 
region of 
Stockholm 


Group of Swiss 
French-speaking 
hospital 
pharmacists 
(Groupe ment des 
Pharmacies 
Hospitallers 
Romans) 


Kings County 
Hospital Center’s 
(KCHC) Paediatric 
Intensive Care 
Unit (PICU) 


Six hospitals in 
Nepal 


2019 


2018 August 
to 2020 
August 


2012 July 


2021 


NR 


NR 


22 patients 
with 14 
family 
members 
needed 
evaluation 


NR 


145 participants in 
Exercise 1; 95 
participants in 
Exercise 2 


NR 


36 (medical students 
or emergency 
medicine residents), 
9 of these 

patients 


NR 
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coordination during 
disaster exercises. 
Transfer, patients 
evacuated, time to 
evacuate, decision- 
making, leadership, 
resource management, 
simulation system 
effectiveness, proposed 
evacuation plans, 
communication 
procedures, participants' 
perceptions 

Simulation responses, 
communication, disaster 
management, logistical 
activities, 
pharmaceutical 
assistance, quality of 
actions using Likert 
scale 


Transportation, delivery 
of appropriate therapy, 
ED care, discharge 
process, educational 
materials 


Hospital incident 
command area, patient 
care, triage, treatment 
areas, emergency signal, 
internal and external 
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Wallace 
2010 


Wexler 


2017 


Study ID 


Arora 2014 


Bartley 
2006 


United 


RCT 


States 


United 
States 


Type of Disaster 


Trauma care 
centres stress 
management 


Hospital disaster 


Qualitative study 


Simulation 
Exercise 


Full hospital 
simulation, 
“Hospital 
Exercise’ 
(HOSPEX) 


Simulated 
disaster 
exercise 


Emergency 
Department at 
Kings County 
Hospital Center, 
Brooklyn 


ED at WellSpan 
York Hospital, a 
Level | trauma 
centre in south- 
central 
Pennsylvania 


2008 July = NR 


NR NR 


Table 5. Description of disaster details 


Duration of 
exercise 


NR 


NR 


Team members 


Participants (surgeons, 
anaesthesiologists, 
physicians, nurses), 
controller, organisers 


Medical, nursing, and 
administrative staff 


12 cases 


NR 


Evaluation process 


IMPAcT tool for 
skills assessment 


Pre- and post- 
intervention survey 
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coordination 
mechanism, organisation 
issues 

Identification of 
respiratory and 
circulatory compromise, 
provision of definitive 
airway, initiation of 
vasopressors through a 
central line, disposition 


Communication, 
recognition instructions 
response, evacuation 
preparedness 


Summary of process flow 


Live-in simulator 
covering crisis 
management, teamwork, 
and simulated surgeries 


Educational presentation 
and disaster simulation 
exercise 
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Burke 2014 


Campanale 
2022 


Carmichael 
2021 


Clara 2021 


Cristal 2019 


Djalali 2014 


Mass causality 
(earthquake) 


Mass casualty 
Incident (MCI) 


Mass causality 


Severe viral 
pneumonia cases 
with confirmed 
MERS-CoV 


Hospitals 
disaster 
medicine 


Hospitals 
disaster 
medicine 


Full-functional 
disaster 
exercise 


Mass Casualty 
SIMulation 
(MACSIM) 
educational 
program 


Institutional 
simulation 
scenario (ISS) 


Full-scale 
exercise (FSE) 


Simulation- 
based exercises 


Full-scale 
exercise (FSE) 


3 hours, 40 
minutes 


NR 


50 minutes 


3 days 


NR 


Approx. 60 
minutes 


Participants, controller, 
observers 


Participants (including 
physicians, nurses), 
managers, support staff 


Trained observers, 
emergency medicine team, 
simulation faculty, 
participants, controllers, 
exercise design teams 


Participants, controller, 
evaluator, management staff 


NR 


Participants, controller, 
observers 


Quantitative and 
qualitative 
assessment using 
anonymous surveys 


Pre- and post- self- 
administered semi- 
quantitative 
questionnaires 


EM team compiled 
data; debriefing 
meetings held 


10 evaluators 
monitoring against 
capability targets 


NR 


Preparedness 
evaluation checklist 
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Voluntary disaster 
response simulation with 
physicians, nurses, and 
nonclinical personnel 


Educational events for 
hospital personnel using 
MACSIM to improve 
MCI preparedness 


Simulated mass shooting 
with 20 victims, testing 
hospital response within 
50 minutes 


FSE to evaluate response 
to severe viral pneumonia 
cases with confirmed 
MERS-CoV 


Assessment of disaster 
management using 
earthquake mass 
causality disaster 


Transfer of patients to 
hospital with Simple 
Triage and Rapid 
Transport (START) 
procedure 


E-mail: jameel.abualenain @ gmail.com 


Dube 2020 


Facho 2021 


Farahi 2021 


Foo 2021 


Gillett 2008 


Gryth 2010 


Haverkort 
2017 


Juelsgaard 
2022 


COVID-19 
pandemic 


Mass casualty 
incident (MCI) 


Hospitals 
disaster 
medicine 


Mass causality 
(earthquake) 


Mass casualty 
incidents (MCI) 


Major aircraft 
accident 


Mass casualty 
Incident (MCI) 


COVID-19 
pandemic 
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Simulation- 


based learning 


High-fidelity 
simulation 


Simulation— 
optimisation 
approach 
(hybrid 
approach) 


Unplugged 
full-scale 
exercise 


High-fidelity 
simulators 


Full-scale 
exercise 


Simulation 
exercise (full- 
scale trauma 
drill) 


Full-scale in- 


situ simulation 


training 


NR 


Less than 4 
hours 


NR 


NR 


NR 


Hours to 
minutes (not 
well 
described) 


3 weeks 


Participants, evaluators, 
controllers 


Physicians, cases, 
evaluators, controllers 


Physicians, cases, 
evaluators, controllers 


Physicians, nurses, logistical 


personnel 


Simulators, participants, 
evaluators 


Participants, evaluators, 
controllers 


Participants, controller, 
evaluator, mock patients 


Participants (university 
professionals), controller, 
observer (interviewers) 


NR 


Evaluation checklist 


Evaluating ED 
system 


Regular meetings, 
radio communication 
monitoring, on-site 
observation 


Trained evaluators 


Trained observers, 
performance 
indicators 


Point-of-view 
cameras 


Focus group 
interview 
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Over 400 acute care 
simulations to prepare for 
the COVID-19 pandemic 


Mass casualty incident 
with urgent interventions 
by physician team 


Simulation replications 
for performance 
measures 


Testing disaster medical 
assistance teams’ 
response in earthquake 
scenario 


Simulated mass casualty 
events in subway station 
and football stadium 


Simulated commercial 
airplane crash at major 
airport 

Mock patients with 
cameras simulate trauma 
drills for protocol 
development 
Hospital-wide simulation 


task force proposed for 
knowledge sharing 
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Kohlhoff 
2012 


Kaplan 
2012 


Klima 2012 


McElroy 
2019 


Obaid 2017 


Radestad 
2012 


Influenza 
pandemic 


Mass causality 
(tornado 
disaster) 


Mass causality 


Mass causality 


General disaster 
preparation 


Major aircraft 
accident 
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Full-scale ie 
exercise 
Emergency 
preparedness 
disaster 
simulation 
(EPDS) 
Full-scale 
regional 
exercise 
(FSRE) 


30-45 
minutes 


NR 


Operation 
Continued Care 
full-scale 
exercise 


Six functional 


k 3 hours 
exercises 


Full-scale 
exercise 


292 minutes 


Participants (university 
professionals), controller, 
observer 


Team leader, triage staff 
nurse, bedside assistants, 
controller 


Participants, controllers, 
exercise design teams, 
evaluator 


Participants, communication 
team, resource request team, 
triage team, OHTrac input 
team 


Command centres, 
participants, controllers, 
observers 


Participants, controller, 
observers 


Evaluation using 
standardised forms 


Pre- and post- 
simulation surveys 
with self-reported, 
anonymous 
responses 


Third-party 
evaluators, after- 
action evaluation 


Post-exercise 
analysis in after- 
action 


report/improvement 


plan 
Homeland Security 


Exercise Evaluation 


Program (HSEEP; 
Washington DC, 
USA) 

External evaluators 


were registered using 


standardised 
performance 


indicators and patient 


outcome indicators. 
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Simulating pandemic 
influenza outbreak with 
adapted case definition 


Tornado hitting an 
assisted living facility 
with injuries and fire 


Simulated terrorist 
assault with train 
derailment, involving 281 
volunteer patients 


Staged terrorist assaults 
at three locations, 
involving 445 mock 
victims 


Six functional exercises 
to improve regional 
planning and 
collaboration 


Aircraft crash scenarios 
with 99 and 100 victims 
in 2008 and 2010 
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Radestad Mass casualty 
2023 incidents (MCI) 
Trauma mass- 
Shrestha casualty 
ce Incidents 
Mass causality 
Schumacher (road traffic 
2022 accident and 
terrorist attack) 
Mass causality 
(influx of 
Seer ortcall Vill 
children) 
Wallace Influenza 
2010 pandemic 
Wexler Mass casualty 
2017 (active shooting) 


NR: Not reported. 
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Mass Casualty 
Simulation 
system 
(MACSIM) 
Full-scale 
simulation 
exercise 


Full-scale 
simulation 
exercise 


Full-scale 
chemical 
exposure 
exercise 


High-fidelity 
simulator 
patients and 
human actor 
patients in a 
surge setting 


Full-scale 
active shooter 
exercise 


11 hours 


30 minutes 


3-4 hours 


90 minutes 
(patient 
briefing from 
24 hours 
prior) 


NR 


NR 


Command group, 
physicians, nurses, support 
staff 


Participants, controller, 
evaluator 


Participants, assessors 


Patients, participants, 
evaluators, controller 


Participants (physician, 
residents, nurse, technician), 
12 patients 


Participants, controllers 


Post-exercise surveys 
and open-ended 
questions for 
feedback 


Standardised 
evaluation tool 


Harvard School of 
Public Health's 
Emergency Exercise 
Evaluation Toolkit 
Homeland Security 
Exercise and 
Evaluation 

Program (HSEEP) 
terms for a full-scale 
exercise 


Standardised data 
collection tool, 
checklist 


Closed-circuit video 
and portable video 
cameras were utilised 
to provide feedback 
for debriefing 
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Two exercises testing 
evacuation plans and 
application 


Assessment of disaster 
management capabilities 
in six hospitals 


Simulated road traffic 
accident and terrorist 
attack scenarios 


Drill involving victims of 
chemical exposure, 

evaluating surge response 
and medical management 


Comparison of 
resuscitation times for 
simulator and human 
actor patients in ED 


Full-scale exercise in ED 
with an active shooter 
scenario 
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Effectiveness of simulations 


The included studies systematically revealed crucial 
areas for disaster response improvement, shedding 
light on communication breakdowns, equipment 
deficiencies, and flaws in specific emergency plans. 
For example, Djalali (2014) highlights the successful 
implementation of Simple Triage and Rapid 


Transport (START) in catastrophe — scenarios, 
demonstrating the practical benefits of such 
simulations for real-world settings. Simulation 


appears useful not only as an educational aid, but 
also as a diagnostic tool that identifies weaknesses 
which might otherwise go undetected. 


Identification of gaps, challenges, and limitations 


However, it is essential to approach the findings with 
a nuanced understanding, considering the limitations 
across various studies. When evaluating the results, 
potential biases, short sample sizes, and actor-related 
issues should all be considered. Recognising the 
diversity in simulation approaches—from high 
fidelity simulators to functional exercises and in-situ 
simulations—enhances our understanding of the 
broad landscape of disaster preparedness research. 


Recommendations and implications 


These studies go beyond theoretical concerns to 
provide practical ideas for improving hospital 
readiness. Suggestions include mandating hospital- 
wide involvement, appointing dedicated Emergency 
Management Officers, and utilising simulation- 
optimisation methodologies. As we work our way 
through these collective findings, it becomes clear 
that disaster preparation simulations not only 
increase education and readiness, but also serve as a 
platform for continual improvement within the 
healthcare system. 


IV. DISCUSSION 


Disaster preparation simulation exercises are critical 
to assessing and improving the performance of 
healthcare systems. This systematic review 
investigates specifically the role of full-scale 
simulation exercises (FSSE) and identifies gaps to 
enhance the response of healthcare systems to 
disasters. 

Our study emphasises the effectiveness of FSSE as a 
reliable real-world approach, and highlighted their 
role in the identification and solution of specific 
safety issues that are often hidden and unpredictable. 
The success stories of these simulation 
methodologies include those of Carmichael et al. 
(21) and Farahi et al. (28), who demonstrated their 
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use of training in real-world circumstances. 
Furthermore, their net benefits extended beyond 
individual skills development. Additionally, several 
studies, such as those by Kohlhoff et al. (34), and 
Obaid et al. (38), emphasised a significant impact on 
healthcare systems, with a crucial role in evaluating 
decision-making, encouraging regional 
collaboration, and providing insights. 

Simulation not only validates readiness, but also acts 
as a diagnostic tool for identifying the ideal disaster 
response. According to Shrestha 2022 (10) and 
Cristal 2019 (24), high-quality simulations provide 
opportunities for improvement by identifying issues 
such as communication breakdowns, equipment 
deficiencies, and weaknesses in specific emergency 
plans. As evidenced by Foo (29), the integration of 
disaster medical assistance teams (DMATSs) ensures 
effective command, control, and communication, 
while allowing for improvement in health 
assessments. 

The wide variety of simulated scenarios, ranging 
from trauma centre stress management to mass 
casualty catastrophes involving — earthquakes, 
pandemics, and active shooter scenarios, exemplifies 
these exercises’ adaptability in dealing with diverse 
crisis situations and ensures a comprehensive 
approach to disaster preparedness and prediction, 
which improves response in real-life situations. 
Furthermore, the range of exercise durations, from 
30-minute simulations to multi-day events, provides 
flexibility in fulfilling diverse training requirements. 
The variety of evaluation measures used in different 
studies of high-stress simulations, including 
checklists, quantitative and qualitative surveys, and 
specialised evaluation tools, reflects the multifaceted 
nature of disaster preparedness. In addition to the 
conventional focus on _ technical abilities, 
nontechnical factors such as communication skills, 
teamwork, decision-making, healthcare 
infrastructure, and operational readiness are also 
examined. 

Radestad (40) demonstrates the utility of a 
simulation model in refining hospital evacuation 
preparations for mass causality crises. Their system 
makes it easier to build effective and practical 
evacuation plans, protocols, and procedures for 
actual crisis scenarios. 

This is the first systematic review of its kind, and 
highlights the effectiveness of full-scale simulation 
(FSS) in enhancing participants’ skills and 
uncovering hidden safety issues in hospital settings 
during disaster preparedness’ exercises. It 
systematically identifies crucial areas for 
improvement that are addressed by simulation 
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exercises, including communication breakdowns, 
equipment deficiencies, and flaws in_ specific 
emergency plans. Additionally, it evaluates the range 
of simulation approaches used in _ disaster 
preparedness research. Mahdi et al.summarised the 
extensive process of developing various exercise 
types, evaluation mechanisms, simulation exercise 
design models, and guidelines for simulation 
exercise development (45). Their work underscores 
the importance of a logical and scientific approach to 
evaluating disasters in simulation exercises, and 
touches on the positive impact of simulations and the 
importance of their evaluation. Meanwhile, the 
geographical variance of the included studies 
highlights the dynamic nature of disaster 
preparedness (45). 

The inclusion of a wide variety of study designs, 
such as prospective cross sectional studies, pre-post 
intervention surveys, qualitative investigations, and 
mixed methods approaches, reflects the diversisty of 
organisational complexities, views and attitudes, and 
provides a comprehensive picture of emergency and 
disaster readiness. An important point emphasised 
by this study is the significance of collaboration at 
all levels and teamwork during disaster response, 
involving _ patients, volunteers, healthcare 
professionals, and administrative personnel. 
Furthermore, a thorough understanding of the 
various stakeholders’ roles, expectations, and soft 
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Screening 


Records identified from: 
PubMed: (n = 1288) 
Scopus: (n = 538) 

Web of Science: (n = 434) 
Cochrane Library: (n = 138) 


Total: (n = 2398) 


Records screened by title and 
abstract: 
(n = 1793) 


Reports sought for retrieval: 
(n = 59) 


Reports assessed for eligibility: 
(n = 59) 


Reports of included studies: 
(n = 28) 
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Records removed before screening: 


Duplicate records removed: (n = 
605) 

Records marked as ineligible by 
automation tools: (n = 0) 
Records removed for other 
reasons: (n = 0) 


Records excluded: 
(n = 1734) 


Reports not retrieved: 
(n= 0) 


Reports excluded: (n = 31) 


No full text available: 2 

Not our population: 5 
Different study intervention: 7 
Short report: 2 

Not our outcome: 10 

Review article: 5 


Figure 1. PRISMA flow diagram of studies’ screening and selection 
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